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Z- TRANSFORM IMPLEMENTATION OF DIGITAL WATERMARKS 

\ /PRT.ATF.D APPTjT CATIONS 

/ This application relates to U.S. Patent Application 

Serial No. 08/489,172 filed on June 7, 1995, U.S. Patent 
5 Application Serial No. 08/587,944 filed on January 17, 
1996, U.S. Patent Application Serial No. 08/587,943 
filed on January 16, 1996, and U.S. Patent Application 
Serial No. 08/677,435 filed on July 2, 1996. Each of 
these related applications is incorporated herein by 

10 reference in their entirety. 

PACKOPOITNP OF THE INVENTION 

Digital distribution of multimedia content (audio, 
video, etc.) and the impending convergence of industries 

15 that seek to make this goal a reality (computer, 

telecommunications, media, electric power, etc.) collide 
with the simplicity of making perfect digital copies. 
There exists a vacuum in which content creators resist 
shifts to full digital distribution systems for their 

20 digitized works, due to the lack of a rroans to protect 
the copyrights of these works . In order to make such 
copyright protection possible, there must exist a 
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mechanism to differentiate between a master and any of 
its derivative copies. The advent of digital watermarks 
makes such differentiation possible. With 
differentiation, assigning responsibility for copies as 
5 they are distributed can assis: in the support and 
protection of underlying copyrights and other 
"neighboring rights," as well as, the implementation of 
secure metering, marketing, and other as yet still 
undecided applications. Schemes that promote 
10 encryption, cryptographic containers, closed systems, 

and the like attempt to shift control of copyrights from 
their owners to third parties, requiring escrow of 
masters and payment for analysis of suspect, pirated 
copies. A frame-based, master- independent , multi- 
15 channel watermark system is disclosed in U.S. Patent 

Application Serial No. 08/489,172 filed on June 7, 1995 
and entitled "STEGANOGRAPHIC METHOD AND DEVICE", U.S. 
Patent Application Serial No. 08/587,944 filed on 
January 17, 1996 and entitled "METHOD FOR HUMAN -ASSISTED 
20 RANDOM KEY GENERATION AND APPLICATION FOR DIGITAL 

WATERMARK SYSTEM", and U.S. Patent Application 08/587,943 
filed on January 16. 1996 and entitled "METHOD FOR STEGA- 
CIPHER PROTECTION OF COMPUTER CODE". These applications 
describe methods by which copyright holders can 
25 watermark and maintain control over their own content. 
Any suspect copies carry all necessary copyright or 
other "rights" information within the digitized signal 
and possession of an authorized "key" and the software 
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(or even hardware) described in these applications would 
make determination of ownership or other important 
issues a simple operation for the rights holder or 
enforcer . 

5 Optimizing watermark insertion into a given signal 

is further described in the U.S. Patent Application 
Serial No. 08/677,435 filed on July 2, 1996 and entitled 
"OPTIMIZATION METHODS FOR THE INSERTION, PROJECTION AND 
DETECTION OF DIGITAL WATERMARKS IN DIGITIZED DATA". This 

10 application discloses accounting for the wide range of 
digitally-sampled signals including audio, video, and 
derivations thereof that may constitute a "multimedia" 
signal. The optimization techniques described in that 
application take into account the two components of all 

15 digitization systems: error coding and digital filters. 
The premise is to provide a better framework or 
definition of the actual "aesthetic" that comprises the 
signal being reproduced, whether through commercial 
standards of output (NTSC, CD-quality audio, etc.) or 

20 lossless and lossy compression (MPEG-2, Perceptual Audio 
Coding, AC-3, Linear Adaptive Coding, and the like) , so 
that a watermark may be targeted at precisely the part 
of the signal comprising such an "aesthetic" in order 
that it be as robust as possible (i.e., difficult to 

2 5 remove without damaging the perceptual quality of the 
signal) . However the content is stored, the signal 
still carries the digital watermark. Additionally, 
transmission media may be characterized as a set of 
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"filters" that may be pre-analyzed to determine the best 
"areas" of the signal in which watermarks "should" be 
encoded, to preserve watermarks in derivative copies and 
ensure maximum destruction of the main, carrier signal 
5 when attempts are made to erase cr alter the watermarked 
content . 

Optimal planning of digital watermark insertion 
can be based on the inversion of digital filters to 
establish or map areas comprising a given content 
10 signal's "insertion envelope." That is, the results 
of the filter operation are considered in order to 
"back out" a solution. In the context of this 
discussion, the phrase "inverting" a filter may mean, 
alternatively, mathematical inversion, or the normal 
15 computation of the filter to observe what its effect 
would be, were that filter applied at a later time. 
Planning operations will vary for given digitized 
content: audio, video, multimedia, etc. Planning will 
also vary depending on where a given "watermarker" is 
20 in the distribution chain and what particular 

information needs that user has in encoding a given 
set of information fields into the underlying content. 
The disclosures described take into account discrete- 
time signal processing which can be accomplished with 
25 Fast Fourier Transforms that are well-known in the art 
of digital signal processing. Signal characteristics 
are also deemed important: a specific method for 
analysis of such characteristics and subsequent 
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digital watermarking is disclosed in further detail in 
this application. The antecedents of the present 
invention cover time and frequency domain processing, 
which can be used to examine signal characteristics 
5 and make modifications to the signal. A third way 
would be to process with z- transforms that can 
establish signal characteristics in a very precise 
manner over discrete instances of time. In 
particular, z-transform calculations can be used to 

10 separate the deterministic, or readily predictable, 
components of a signal from the non-deterministic 
(unpredictable or random) components. It should be 
apparent to those skilled in the art that non- 
deterministic is a subjective term whose 

15 interpretation is implicitly affected by processing 
power, memory, and time restrictions. With unlimited 
DSP (digital signal processing) power, memory, and 
time to process, we might theoretically predict every 
component of a signal. However, practicality imposes 

20 limitations. The results of the z-transform 

calculations will yield an estimator of the signal in 
the form of a deterministic approximation. The 
difference between a signal reconstituted from the 
deterministic estimator and the real signal can be 

25 referred to as error, and the error in an estimator 
can be further analyzed for statistical 
characteristics. Those skilled in the art will be 
aware that Linear Predictive Coding (LPC) techniques 
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make use of these properties. So the error can be 
modeled, but is difficult to reproduce exactly from 
compressed representations. In essence, this error 
represents the randomness in a signal which is hard to 
5 compress or reproduce, but in fart may contribute 

significantly to the gestalt perception of the signal. 

The more elements of error determined with z- 
transforms, the better able a party is at determining 
just what parts of a given carrier signal are 

10 deterministic, and thus predictable, and what elements 
are random. The less predictable the watermark- 
bearing portion of a signal is and the more it 
contributes to the perception of the signal, as 
previously disclosed, the more secure a digital 

15 watermark can be made. Z-transform analysis would 

disclose just which phase components are deterministic 
and which are random. This is because it is difficult 
to compress or otherwise remove unpredictable signal 
components. Error analysis further describes the 

2 0 existence of error function components and would 
reliably predict what signals or data may later be 
removed by additional z-transform analysis or other 
compression techniques. In effect, the error analysis 
indicates how good an approximation can be made, 

2 5 another way of stating how predictable a signal is, 
and by implication, how much randomness it contains. 
Z-transforms are thus a specialized means to optimize 
watermark insertion and maximize the resulting 
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security of encoded data from attempts at tampering. 
The results of a Z-transform of input samples could be 
analyzed to see "exactly" how they approximate the 
signal, and how much room there is for encoding 
5 watermarks in a manner that they will not be removed 
by compression techniques which preserve a high degree 
of reproduction quality. 

Time is typically described as a single 
independent variable in signal processing operations 
10 but in many cases operations can be generalized to 
iltidimensional or multichannel signals. Analog 
signals are defined continuously over time, while 
digital signals are sampled at discrete time intervals 
to provide a relatively compact function, suitable for 
15 storage on a CD, for instance, defined only at 

regularly demarcated intervals of time. The accrued 
variables over time provide a discrete-time signal 
that is an approximation of the actual non-discrete 
analog signal. This discreteness is the basis of a 
20 digital signal. If time is unbounded and the signal 
comprises all possible values, a continuous -valued 
signal results. The method for converting a 
continuous-valued signal into a discrete time value is 
known as sampling. Sampling requires quantization and 
25 quantization implies error. Quantization and sampling 
are thus an approximation process. 
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Discreteness is typically established in order to 
perform digital signal processing. The issue of 
deterministic versus random signals is based on the 
ability to mathematically predict output values of a 
5 signal function at a specific time given a certain 
number of previous outputs of the function. These 
predictions are the basis of functions that can 
replicate a given signal for reproduction purposes. 
When such predictions are mathematically too 

10 complicated or are not reasonably accurate, 

statistical techniques may be used to describe the 
probabalistic characteristics of the signal. In many 
real world applications, however, determinations of 
whether a signal, or part of a signal, is indeed 

15 random or not is difficult at best. The watermark 
systems described in earlier disclosures mentioned 
above have a basis in analyzing signals so that 
analysis of discrete time frames can be made to insert 
information into the signal being watermarked. When 

20 signal characteristics are measured, a key factor in 

securely encoding digital watermarks is the ability to 
encode data into a carrier signal in a way that mimics 
randomness or pseudo randomness so that unauthorized 
attempts at erasing the watermark necessarily require 

25 damage to the content signal. Any randomness that 
exists as a part of the signal, however, should be 
estimated in order that a party seeking to optimally 
watermark the input signal can determine the best 
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location for watermark information and to make any- 
subsequent analysis to determine the location of said 
watermarks more difficult. Again, typical 
implementations of signal processing that use z- 
5 transforms seek to describe what parts of the signal 
are deterministic so that they may be described as a 
compact, predictable function so that the signal maybe 
faithfully reproduced. This is the basis for so- 
called linear predictive coding techniques used for 
10 compression. The present invention is concerned with 
descriptions of the signal to better define just what 
parts of the signal are random so that digital 
watermarks may be inserted in a manner that would make 
them more or less tamperproof without damage to the 
15 carrier signal. Additional goals of the system are 
dynamic analysis of a signal at discrete time 
intervals so that watermarks may be dynamically 
adjusted to the needs of users in such instances as 
on-the-fly encoding of watermarks or distribution via 
20 transmission media (telephone, cable, electric 
powerlines, wireless, etc.) 

Signal characteristics, if they can be reasonably 
defined, are also important clues as to what portion 
or portions of a given signal comprise the 
25 "aesthetically valuable" output signal commonly known 
as music or video. As such, perceptual coding or 
linear predictive coding is a means to accurately 
reproduce a signal, with significant compression, in a 
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manner that perfectly replicates the origin,! signal 
Uossless repression, or nearly replicates the signal 
Uossy compression) . One tool to ma*e better 
evaluations of the underlying signal includes the 
cla ss of linear time-invari,nt (LTD systems. As 
pointed out in digital Signal Processing .Principles. 
A1 gorit h ms. and Applications, . 3rd Ed. (ProaKis and 
ManolaKis,. (also Practical D SP Modeling. Techniques. 

r bv con Morgan) the z-transform 
and Programming m C by uon a 

•w. ana lv S is of a continuous -time signal in 
makes possible analysis 01 

th e same manner as discrete-time signals because of 
th e relationship between "the convolution of two time 
domain signals is equivalent to multiplication of 
ch eir corresponding .-transforms." It should be clear 
, cha t characterization and analysis of W I systems is 
useful in digital signal processing; meaning DSP can 
use a z-transform and invert the z-transform to 
ceterministically summarize and recreate a signal's 
tl me domain representation. z-transforms can thus be 
0 used as a mathematical way in which to describe a 

signal's time domain representation where that signal 
may not be readily processed by means of a Fourrer 
C ransform. A goal of the present invention is to use 
S uch analysis so as to describe optimal locations for 
25 „atermar*s in signals which typically have components 
both of deterministic and non-deterministic 
(predictable and unpredictable, respectively, nature, 
such insertion would inherently benefit a system 
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seeking to insert digital watermarks, that contain 
sensitive information such as copyrights, distribution 
agreements, marketing information, bandwidth rights, 
more general "neighboring rights," and the like, in 
locations in the signal which are not easily 
accessible to unauthorized parties and which cannot be 
removed without damaging the signal. Such a technique 
for determining watermark location will help ensure 
"pirates" must damage the content in attempts at 
removal, the price paid without a legitimate "key." 

Some discussion of proposed systems for 
frequency-based encoding of "digital watermarks" is 
necessary to differentiate the antecedents of the 
present invention which processes signals frame-by- 
frame and may insert information into frequencies 
without requiring the resulting watermark to be 
continuous throughout the entire clip of the signal. 
U.S. Patent No. 5,319,735 to Preuss et al . discusses a 
spread spectrum method that would allow for jamming 
via overencoding of a "watermarked" frequency range 
and is severely limited in the amount of data that can 
be encoded-- 4.3 8 -bit symbols per second. 
Randomization attacks will not result in audible 
artifacts in the carrier signal, or degradation of the 
content as the information signal is subaudible due to 
frequency masking. Decoding can be broken by a slight 
change in the playback speed. It is important to note 
the difference in application between spread spectrum 
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in military field use for protection of real-time 
radio signals " versus encoding information into static 
audio files. In the protection of real-time 
communications, spread spectrum has anti-jam features 
5 since information is sent over several channels at 

once, and in order to jam the signal, you have to. jam 
all channels, including your own. In a static audio 
file, however, an attacker has all the time and 
processing power in the world to randomize each sub- 

10 channel in the signaling band with no penalty to 
themselves, so the anti-jam features of spread 
spectrum do not extend to this domain if the encoding 
is sub-audible. Choosing where to encode in a super- 
audible range of the frequency, as is possible with 

15 the present invention's antecedents, can better be 
accomplished by computing the z-transf orms of the 
underlying content signal, in order to ascertain the 
suitability of particular locations in the signal for 
watermark information . 

20 Instead of putting a single subaudible, digital 

signature in a sub-band as is further proposed by such 
entities as NEC, IBM, Digimarc, and MIT Media Lab, the 
antecedent inventions 1 improvement is its emphasis on 
frame -based encoding that can result in the decoding 

25 of watermarks from clips of the original full signal 
(10 seconds, say, of a 3 minute song) . With 
signatures described in MIT's PixelTag or Digimarc/NEC 
proposals, clipping of the "carrier signal" (presently 

12 
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only based on results from tests on images, not video 
or audio signals which have time domains) , results in 
clipping of the underlying watermark. Additionally, 
the present invention improves on previous 
5 implementations by providing an alternative 
computational medium to time/amplitude or 
frequency/energy domain (Fourier Transform) 
calculations and providing an additional measure by 
which to distinguish parts of a signal which are 

10 better suited to preserve watermarks through various 
DSP operations and force damage when attempts at 
erasure of the watermarks are undertaken. Further, 
the necessity of archiving or putting in escrow a 
master copy for comparison with suspect derivative 

15 copies would be unnecessary with the present invention 
and its proposed antecedents. Further, statistical 
techniques, not mathematical formulas, that are used 
to determine a "match" of a clip of a carrier signal 
to the original signal, both uneconomical and 

20 unreasonable, would not be necessary to establish 

ownership or other information about the suspect clip. 
Even if such techniques or stochastic processes are 
used, as in an audio spread- spectrum-based 
watermarking system being proposed by Thorn-EMI's CRL, 

25 called ICE, the further inability to decode a text 

file or other similar file that has been encoded using 
a watermark system as previously disclosed by above- 
mentioned U.S. Patent applications including 
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j „/i novice". "Method for Hunan- 
-Steganographic Method and Device , 

listed Random Key Generation and Application for 

Digital watermark System", "Method for Stega-cipher 

section of colter Code", and "Optimal Methods for 

Protection and Detection of Digital 
5 the Insertion, Protection 

waters in Digitized Data-, -here aU "watermar* 
information" resides in the derivative copy of a 
carrier signal and its clips (if there has been 
clipping. , would see. archaic and fail to suit the 
l0 needs of artists, content creators, broadcasters. 

distributors, and their agents. Indeed, reports are 
that decoding untaxed watermarks with ICE in an 
au dio file experience "statistical" error rates as 

ls and fails to establish more clearly "rights" or 
ownership over a given derivative copy. Human 
Ustening tests would appear a better means of 
authentication versus such -probabalistic 
determination" . This would be especially true if such 
20 systems contain no provision to prevent purely random 

• • vaults as is probable, with "spread 
false-positive results, as is e 

spectrum" or similar "embedded signaling- type 
"watermark," or actually, with a better definition, 
frequency-based, digital signatures. 
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-ITTTOPY THF TNVnUTIOH 

The present invention relates to a method of 
U sing z-transform calculations to encode (and/or 
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decode) independent data (e.g., digital watermark 
data) to a digital sample stream. 

The present invention additionally relates to a 
method of analyzing deterministic and non- 
5 deterministic components of a signal comprised of a 
digital sample stream. Carrier signal independent 
data is encoded in the digital sample stream and 
encoding of the carrier signal independent data is 
implemented in a manner such that it is restricted to 

10 or concentrated primarily in the non-deterministic 

signal components of the carrier signal. The signal 
components can include a discrete series of digital 
samples and/or a discrete series of frequency sub- 
bands of the carrier signal. 

15 The present invention additionally relates to a 

method of using z- transform calculations to measure a 
desirability of particular locations of a sample 
stream in which to encode carrier signal independent 
data. The desirability includes a difficulty in 

2 0 predicting a component of the sample stream at a given 
location which can be measured by the error function. 
The component and location may be comprised of 
information regarding at least one of the following: 
wave, amplitude, frequency, band energy, and phase 

25 energy. The present invention additionally relates to 
a method of encoding digital watermarks at varying 
locations in a sample stream with varying envelope 
parameters. 
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The present invention additionally relates to a 
method of using z-transform calculations to determine 
portions of a signal which may be successfully 
compressed or eliminated using certain processing 
5 techniques, without adverse irapact on signal quality. 

The present invention additionally relates to a 
method of encoding a digital watermark into a digital 
sample stream such that the watermark information is 
carried entirely in the most non-deterministic 
10 portions of the signal. 

DETAILED DESCRIPTION 

The Z-transform is a way of describing the 
characteristics of a signal. It is an alternative to 

15 time/amplitude and frequency/energy domain measures 
which expresses an estimate of periodic components of 
a discrete signal. In a digital signal processing 
environment, a sampling theorem, known specifically as 
the Nyquist Theorem, proves that band limited signals 

20 can be sampled, stored, processed, transmitted, 

reconstructed, desampled or processed as discrete 
values. For the theorem to hold, the sampling must be 
done at a frequency that is twice the frequency of the 
highest signal frequency one seeks to capture and 

25 reproduce. The time and frequency domains are thus 

implicitly important in developing functions that can 
accurately replicate a. signal. In a third domain, the 
z-transform enables analysis of the periodic nature of 
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discrete- time signals (and linear time- invariant 
systems) much" as the Laplace transform plays a role in 
the analysis of continuous -time signals (and linear 
time- invariant systems) . The difference is that the 
5 z-transform expresses results on the so-called z- 

plane, an imaginary mathematical construct which may 
be thought of as a Cartesian coordinate system with 
one axis replaced by imaginary numbers (numbers 
expressed in relation to the square root of -1) . This 

10 may allow manipulations of signals which are not 
possible with Fourier Transform analyses (the 
frequency/energy domain) . At the least, the z- 
transform is an alternative way to represent a signal. 
The imaginary number axis serves as a representation 

15 of the phase of the signal, where the phase oscillates 
through an ordered, bounded set of values over a 
potentially infinite series of discrete time values. 
Phase is the framework for representing the periodic 
nature of the signal. This third method of describing 

20 a discrete-time signal has the property of equating 
the convolution of two time -domain signals in the 
result of the multiplication of those signals 1 
corresponding z-transf orms . By inverting a z- 
transform, the time -domain representation of the 

25 signal may be approximately or wholly reconstructed. 
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To better define the z-transform, it -is a power 
series of a discrete- time signal and is mathematically 
described hence: 

X(z)=E <n)z- n 

where , 

5 x(n) is a discrete- time signal 

X(z) is a complex plane representation 
z is a complex variable 

Because the z-transform is an infinite power 
series, a region of convergence (ROC) is the set of 

10 all values of z where X(z) has a finite value, in 

other words, this is where the series has a computable 
value. Conversely, nonconvergence would mean 
randomness of the signal. 

Where z=0 or z=«, the series is unbounded and 

15 thus the z -plane cannot be defined. What is required 
is a closed form expression that can only be described 
with a region of convergence (ROC) being specified. A 
coordinate in the imaginary z -plane can be interpreted 
to convey both amplitude and phase information. Phase 

20 is closely related to frequency information. Again, 
phase can be understood to oscillate at regular 
periods over infinite discrete time intervals, and is 
used to express information on the periodic nature of 
signals. Thus, as an alternative representation of a 
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c v, 0 i n c describe how a signal 
signal, the z- transform helps descno 

changes over time. 

~* reaion of convergence 

Some parameters of the region 

the establishment of the duration 
(ROC) necessitate the estdu 

s (finite versus infinite, and .-nether the ROC is 

causal, anticasual, or two-sided. Special cases of 
signals include one that has an infinite duration on 

10 and, one that has a finite duration on both the right 
and left sides- Known, respectively, as right-sided, 
left-sided, and finite-duration two-sided. 
Ad ditionally. in order to correctly obtain the time 
d omain information of a signal fro. its .-transform, 
1S further analysis is done. When a signal's — ™ 
is *no„n the signal's seance must he established to 
aescribe the time domain of the signal- a procedure 
k nown as inverse ^-transform, Cauchy integral theorem 
is an inversion formula typically used. Properties of 
20 the ,-transform will now be described so that those 
skilled in the art are able to understand the range 
computations in which .-transforms may be used for 
watermark related calculations. 
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Property 

Notation 
Linearity 
Time shifting 



Scaling in the z-domain 
Time reversal 
Conjugation 
Real Part 
Imaginary Part 
Differential in the 
z-domain 
Convolution 



Correlation 

Initial value theorem 
Multiplication 

ParsevaTs relation 



Time Domain 


z- Domain 


ROC 


x(n) 


X(z) 


ROC r 2 <[z]<ri 


xi(n) 


X,(z) 


ROQ 


x 2 (n) 


X 2 (z) 


ROC 2 


a 1 x 1 (n)+a 2 x 2 (n) 


a 1 X 1 (z)+a 2 X 2 (z) 


At least the 
intersection of ROCi 
and ROC 2 


x(n-k) 


z k X(z) 


That of X(z), except 
z=0 if k>0 nd z=<» if 
k>0 


a n x(n) 


X(a-iz) 


[a]r 2 <[zj<[a]n 


x(-n) 


X(z-i) 


l/ri<[z]<l/r 2 


x*(n) 


X*(z*) 

l/2{X(z)+X*(z*)} 
l/2{X(z)-X*(z*)} 


ROC 


Re{x(n)} 


Includes ROC 


Im{x(n)> 


Includes ROC 


nx(n) 


-z{-z((dX(z)/(dz))} 


r2<[z]<ri 


( Xl (n))*(x2(n)) 


X!(Z)X 2 (Z) 


At least the 
intersection of ROCi 
and ROC 2 


rx,x 2 (l)=x,(l)*x 2 (-l) 


R.v , x : (z)=X i (z)X 2 (r 1 )At least the 






intersection of ROC of 






Xi(z)andX 2 (z l ) 



If x(n) causal 
xi(n)x 2 (n) 



x(0)=lim X(z) 

zto <» 

l/2nj<XXi(v)X2«z/v)v- l dv} At least 

zio» rnr2i<[2j<riur2u 



2 Xi(n)X* 2 (n)=l/2nj {JXi< v)X» 2 « Wv*)v-*dv} 
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Note: ■[]" denote absolute values.- For 
■■Multiplication" and -F.rMv.l-- relation" the ■/■ is 

n a* t-H^ one From Digital Signal 
for "0 " a circle xn trie kul. * 

Processing principles, Algorithms, and Applications, 
- 3rd Ed. Proakis & Manolakis 

The inversion of the *- transform with three 
methods further described, in Digital Signal 
Processing (Principles, Algorithms, and Applications, 
. 3rd Ed. Proakis t Manolakis, as 1, Direct evaluation 
bY contour integration 2) Expansion into a series of 
terms, in the variables and and 3, Partial- 
fraction expansion and table Jookup. Typically the 
cauchy theorem is used for direct evaluation. In 
determining causality. BI systems are well-suited m 
establishing the predictability of time-domain 
characteristics with pole-zero locations. For 
applications of digital watermarks as described in the 
present invention the importance of both alternatively 
describing a signal and establishing deterministic 
characteristics of the signal's components is clear to 
those skilled in the art. Placing watermarks in the 
■random" parts of a signal, those that are difficult 
to predict and thereby compress, would enhance the 
security from attacks by pirates seeking to identify 
s the location of said watermarks or erase them without 
knowing their specific location. Use of .-transforms 
to establish a more secure "envelope" for watermark 
insertion works to the advantage of those seeking to 
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prevent such attacks. Similarly, creation of linear 
predictive coding filters is an excellent example that 
benefits from preanalysis of content signals prior to 
the insertion of watermarks. 
5 This is an extension of the application of 

optimal filter design for applications for frame-based 
watermark systems as described in the above-mentioned 
patent applications entitled "STEGANOGRAPHIC METHOD 
AND DEVICE", "METHOD FOR HUMAN -ASSISTED RANDOM KEY 

10 GENERATION AND APPLICATION FOR DIGITAL WATERMARK 

SYSTEM", and "METHOD FOR STEGA- C I PHER PROTECTION OF 
COMPUTER CODE", "OPTIMAL METHODS FOR THE INSERTION, 
PROTECTION AND DETECTION OF DIGITAL WATERMARKS IN 
DIGITIZED DATA". Recursive digital filters are 

15 efficient for applications dependent on previous 

inputs and outputs and current inputs at a given time- 
- a dynamic filter. The z- transform makes possible 
high performance of time domain digital filtering with 
implementation of recursive filters where signal 

20 characteristics are efficiently identified. 

In one embodiment of the present invention, z- 
transform calculations are performed as an 
intermediate processing step, prior to the actual 
encoding of a digital watermark into a sample stream. 

2 5 The Argent™ digital watermark software, developed by 
The DICE Company, for example, uses a modular 
architecture which allows access to the sample stream 
and related watermark data at various stages of 
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computation, and further allows modules to pass their 
results on (or back) to other modules. Z-transform 
calculations can be integrated into this processing 
architecture either directly in the CODEC module, 
5 which is responsible for encoding information to a 
series of samples, or decoding it from them, or as a 
FILTER module, which provides other modules with 
information on how specific types of filters will 
affect the sample stream. During processing, a series 
10 of sample frames are separated into groupings called 
"windows". Typically the groupings are comprised of 
contiguous series of samples, but this need not be the 
case. Any logical arrangement might be handled. Each 
sample window comprises a finite duration two-sided 
15 signal, a special case for z-transform calculations 
discussed above. 

Each window may then be fed to a z-transform 
calculator (in a FILTER or CODEC module) which derives 
phase composition information from the signal using a 
20 z-transform algorithm. This information summarizes 
estimates of any regular phase components of the 
signal. Note that windows may be dynamically adjusted 
to be longer or shorter duration, or they may be 
computed in an overlapping fashion, with information 
25 about adjacent windows and their z- transforms being 
considered with regard to the current transform. 
Windows might have weightings applied to sample frames 
in order to emphasize some portions or de-emphasize 
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others. Using these additional modifications may help 
to smooth discontinuities between window calculations 
and provide a better average estimate over longer 
portions of a signal. 
5 The resulting z- transform information could be 

visualized by placing points of varying brightness or 
color (which corresponds to an amplitude) on the unit 
circle in the complex z-plane (the circle centered at 
z = 0.0, 0.0 with radius 1). These points symbolize 

10 recurrent signal components at particular phases 

(where phase is determined by the angle of the line 
drawn between the point on the perimeter of the circle 
and its center) . A deterministic approximation of the 
signal could then be reconstructed with all possible 

15 times represented by multiplying phase by the number 
of revolutions about the circle. Positive angle 
increments move forward in time, while negative 
increments move backward. The phase components 
yielded by the z- transform are then used to summarize 

20 and reproduce an estimate of the deterministic portion 
of the signal. Typically one may invert the z- 
transform calculations to produce this estimate in 
terms of a series of wave amplitude samples. By 
calculating the error rate and location of such errors 

25 in the estimated signal versus the original, the 

system can determine exactly where a signal is "most 
non-deterministic," which would constitute promising 
locations within the sample stream to encode watermark 
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information. Note that location could be construed to 
mean any combination of sample, frequency or phase 
information . 

The process described above is, in principle, an 
5 inversion of the type of process used for Linear 
Predictive Coding (LPC) and is a general example of 
"filter inversion" for optimal watermark planning. 
The type calculations are performed in order to 
determine what parts of the signal will survive the 
10 LPC process intact, and are thus good places to place 
watermarks which are to survive LPC. In LPC, the 
:f| deterministic portion of a signal is compressed and 

fji the non-deterministic portion is either preserved as a 

[y whole with lossless compression or stochastically 

15 summarized and recreated randomly each time the 
"signal" is played back. 

Q 
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